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Processing of a data set 



□ 



The invention relates to the processing of a data set. The invention can be 
used, for example, for filtering a set of pixels obtained by decoding in accordance with the 
MPEG4 standard. (MPEG is the acronym for Motion Picture Experts Group.) 



Processing of a data set can be effected by means of a processing circuit which 
supplies an output data item in response to a group of data. The processing circuit receives 
each data item of the group via a different terminal. An FIR filter is an example of such a 
processing circuit. (FIR is the acronym for Finite Impulse Response.) Each terminal has an 
^fl 10 associated filter coefficient; The filter multiplies a data item applied to a certain terminal by 

the filter coefficient associated with this terminal. This results in a weighted data item. The 
^ ¥ filter adds the weighted data thus obtained in order to obtain an output data item. The output 

data item v^ll be correct only if each data item of a group is applied to a specific terminal. 

An implementation as described hereinbefore wall have an input circuit for the 
fl3 15 formation of successive groups of data in order to apply these to the processing circuit. The 

ry 

input circuit can be arranged in such a maimer that there is not a fixed relationship between 
Q the position of a data item in a group and the terminal to which this data item is to be applied. 

For example, the input circuit can form a group of data comprising four data items: A, B, C 
and D in accordance with their respective positions. The data A, B, C and D should be 

20 applied td'the terminals numbered 1, 2, 3 and 4, respectively. Subsequently, the input circuit 
can form a following group comprising the data E, B, C, D in accordance with their 
respective positions. (A is replaced with E.) The data E, B, C and D should be applied to the 
terminals numbered 4, 1, 2 and 3, respectively. 

The successive groups of data can be applied to the processing circuit by 

25 means of an intercormection network. As a matter of fact, the interconnection network 
enables the respective positions of the data of a group to be changed. The interconnection 
network consequently enables each data item to be applied to the appropriate terminal. 
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* ' It is an object of the invention to enable low-cost processing of a set of data of 
which some data may be non- valid. 

In accordance with the invention such a processing is characterized as follows. 
An input circuit forms successive groups of data and, moreover, generates basic control data 
5 and additional control data for each group of data. A basic control data item indicates for 
each data item one of a plurality of terminals to which the data item should be applied. An 
additional control data item indicates for each data item if this input data item is valid or not 
valid. An interconnection network applies the successive groups of data to the terminals in 
dependence on the basic control data and the additional control data. The interconnection 
10 network is arranged to apply a data item to the terminal indicated by the basic control data if 
the data item is valid. If the data item is not valid the interconnection network applies, instead 
of it, a valid other data item. A data processing circuit processes the data applied to the 
terminals in order to obtain an output data item. 

P 

.^Q The invention takes the following aspects into consideration. A set of data may 

]0 1 5 include non-valid data. For example, a set of pixels resulting from MPEG4 decoding 

ail 

typically represents a visual object. Certain pixels belong to the object while other pixels do 
not belong to the object. The last-mentioned pixels are not valid. 
H If a set of data contains non-valid data there is a risk of distortion. Distortion 

'Q will occur when a group of data contains one or more non- valid data items while the resulting 

Jj? 20 output data item is considered to be valid. Let us consider, for example, asymmetrical FIR 

:|t filtering. In general, the output of the FIR fiUer will be regarded as valid if the data applied to 

!^ the central terminal of the FIR filter is valid. Let it be assumed now that another data item of 

pit 

the group is not valid. In this case, the output data item v^U be determined partly by this non- 
valid data item, which means a distortion of the result of the FIR filtering. 

25 ' The risk of distortion can be precluded by means of a pre-processing of the set 

of data. The pre-processing assigns a substitute or padding value to each non- valid data item. 
This padding value vnll generally be determined on the basis of one or more valid data items. 
The padding value may be, for example, be the mean of the values of all the valid data items. 
This padding value will thus be generic and adapted to be assigned to each non-valid data 

30 item. Another option is to calculate a padding value for each individual non- valid data item. 

However, a pre-processing as described hereinbefore will be comparatively 
complex and, consequently, slow and costly. For example, the calculation of a generic 
padding value requires that all the valid data are taken into account. If a padding value is 
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calculated for each individual non-valid data item this also means that numerous operations 
have to be performed. 

In accordance with the invention, a non- valid data item actually replaced by a 
valid data item by means of an intercormection network. This substitution is then effected 
during the application of a group of data to the processing circuit. Thus, there is no need to 
carry out a pre-processing in order to assign a padding value to each non- valid data item. The 
invention consequently enables a cheaper and faster data processing to be achieved. 

These as well as other aspects of the invention will be described in more detail 
v^th reference to the foUov^ng Figures. 




Fig. 1 is a conceptual diagram which illustrates the basic characteristic 
features described hereinbefore; 

Fig. 2 is a diagram which shows an MPEG4 video filtering arrangement; 

Fig. 3 is a diagram which illustrates a method in accordance with which a set 
of input pixels and a set of Boolean values are stored in the MPEG4 video filtering 
arrangement; and 

Fig. 4 is a diagram which shows a multiplexing device which forms part of the 
MPEG4 video filtering arrangement. 



The following remarks relate to the reference signs. Similar entities bear 
identical reference letters in all the Figures. A plurality of similar entities may appear in a 
single Figure. In that case a numeral is suffixed to the reference letters in order to distinguish 
between similar entities. The numeral or suffix may be omitted where appropriate. This 
applies both to the description and to the Claims. 

Fig. 1 illustrates the basic features described hereinbefore. A data processing 
arrangement comprises an input circuit [INP], an interconnection network [ICN] and a data 
processing circuit [PRC]. The input circuit [INP] forms successive groups of data [GRP] and, 
moreover, generates basic control data [BCD] and additional control data [SCD] for each 
group of data [GRP]. A basic control data item [BCD] indicates for each data item one of a 
plurality of terminals [1-4] to which the data item should be applied. An additional control 
data item [SCD] indicates for each data item if this data item is valid [+] or not valid [-]. The 
interconnection network [ICN] applies the successive groups of data to the terminals [1-4] in 
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cfependence on the basic control data [BCD] and the additional control data [SCD]. The 
interconnection network [ICN] applies a data item to the terminal indicated by the basic 
control data [BCD] if the data is valid [-1-]. If the data item is not valid [-] the interconnection 
network [ICN] applies a valid data item instead. The data processing circuit [PRC] processes 
5 the data applied to the terminals [1-4] in order to obtain an output data item. 

The features illustrated in Fig. 1 can be used, for example, for processing a set 
of pixels obtained by decoding in accordance with the MPEG4 standard. Such a set of pixels 
typically represents an object such as, for example, a person, a ball or a house. It is 
accompanied by a set of Boolean values. There is a Boolean value for each pixel. The 
10 Boolean -value-indicates whether or not _the. relevant pixeLbelongs to the object. Thus, the set _ 
of Boolean values forms a shape description. 

Fig. 2 shows an MPEG4 video filtering arrangement. MPEG4 video filtering 
arrangement receives a set of input pixels [IPS] and an associated set of Boolean values 
[BVS]. In response thereto, it supplies a set of filtered pixels [FPS], The MPEG4 video 
1 5 filtering arrangement comprises 4 memory banks [MB], numbered from one to four 

[MB1-MB4]. Each memory bank [MBJ comprises a section [SMPL] for the storage of pixels 
and another section [SHP] for the storage of the Boolean values. The MPEG4 video filtering 



W 

111 

arrangement fiirther comprises a control circuit [CNTRL], four multiplexing devices [MA], 
numbered from one to four [MA1-MA4], and a filter [FIL] having four taps [T], numbered 
m 20 from one to four [T1-T4]. Each tap [T] has an associated filter coefficient [C]. 



The MPEG4 video filtering arrangement operates as follows. The MPEG4 
video filtering arrangement receives the set of input pixels [IPS] in the form of a stream. In 
parallel it receives the set of Boolean values [BVS], also in the form of a stream. The two 
streams are synchronized. For each pixel and Boolean value received the control circuit 
25 [CNTRLpselects a certain memory bank [MB] in which the pixel and the Boolean value are 
stored. Thus, the set of input pixels [IPS] and the set of Boolean values [BVS] are stored in 
the four memory banks [MB] in accordance with a certain method. 

Fig. 3 illustrates the method in accordance with which the set of input pixels 
and the set of Boolean values are stored in the memory banks. Fig. 3 shows a part of a matrix. 
30 This matrix represents both the set of input pixels and the set of Boolean values. Each cell of 
the matrix represents a pixel and its associated Boolean value. The number shown in a cell is 
the number of the memory bank which stores the pixel and the Boolean value. For example, 
the top-left pixel [1] of the set of input pixels is stored in the first memory bank. Its right- 
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Mhnd neighbor [2], its neighbor below it [3] and its diagonal neighbor [4] are stored in the 
second, the third and the fourth memory bank, respectively. 

Fig. 3 also shows a window [W]. The window [W] measures 2 by 2 cells: The 
window [W] defines four pixels and four Boolean values stored in the memory banks. These 
5 pixels and Boolean values are read from the memory bank in a first read operation. The 
window [W] moves one imit to the right for a second read-out of the memory bank. The 
window [W] keeps moving one unit to the right until it reaches the right-hand side of the 
matrix. Subsequently, the window [W] returns to the left-hand side of the matrix after having 
moved one unit downward. The window [W] thus scans the matrix horizontally. Each 
1 0 different position of the window [W] corresponds to a read-out of four pixels and four 
Boolean values. 

It is to be noted that the method illustrated in Fig. 3 has the following 
charafcteristic feature. For any position occupied of the window [W] each pixel and each 
Jg Boolean value defined by the window [W] is stored in a different memory bank. As a result 

ifl 1 5 of this, only one read-out per memory bank is required in order to obtain all the pixels 

hi 



^0 



defined by the window. These read operations can be performed in parallel. Thus, in 
principle, one clock cycle suffices to read all the pixels defined by the window. As a result, 
1^ the method illustrated in Fig. 3 enables a fast read-out and, consequently, a fast filtering to be 

JL^ achieved. 

IB 20 Each read-out performed by moving the window [W] in Fig. 3 results in a 

'1 group of pixels that produces an output pixel. The output pixel is obtained by means of the 

Q filter [FIL] shown in Fig. 2. There is a fixed relationship between the position of a pixel in 

the window [W] and the tap [T] to which the pixel is to be applied. The top-left pixel of the 
window should be applied to the first tap [Tl]. The top-right pixel of the window should be 
25 applied to'the second tap [T2]. The bottom-left pixel of the window should be applied to the 
third tap [T3]. The bottom-right pixel of the window should be applied to the fourth tap [T4]. 

The control circuit [CNTRL] shown in Fig. 2 carries out the read operations 
described hereinbefore. Each read operation thus produces a group of four pixels. The control 
circuit [CNTRL] supplies a set of control words [CW] with each pixel read operation. For 
30 each pixel of the group the set of control words [CW] indicates the tap [TP] to which the 
pixel is to be applied. 

In more detail, the control circuit [CNTRL] generates four control words, 
numbered from one to four [CW1-CW4], for the first to the fourth multiplexing device 
[MA1-MA4]. The first control word [CWl] indicates the memory bank [MB] from which the 
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pixel to be applied to the first tap [Tl] originates. Likewise, the second, the third and the 
fourth control words [CW2, CW3, CW4] indicate the memory banks [MB] from which the 
pixels to be applied to, respectively, the second tap, the third tap and the fourth tap [Tl, T3, 
T4] originate. Each control word [CW] may comprise, for example, a two-bit binary value; 
5 This value indicates the memory bank [MB] from which the pixel to be applied to the 
relevant tap [T] originates. 

The control circuit [CNTRL] can be realized, for example, by means of 
programmable counters. A programmable counter can be used to select a memory bank [MB] 
during loading of the set of input pixels [IPS]. Four programmable counters can be used to 
10_ _ generate.addresses during the ]oa^^ 

memory bank [MB]. The programmable counter for the selection of a memory bank [MB] 
activates that programmable counter of these four programmable coimters which corresponds 
to th^ selected memory bank [MB]. Four other progranamable counters can be used to 
•3 perform the read operation in order to form successive groups of pixels. For each read 

kQ 1 5 operation these four programmable counters will generate four addresses in parallel, i.e. one 

;^ address for each memory bank [MB]. Other programmable counters can be used to generate 

ili control words [CW]. The control word [CW] are cyclic, which is apparent from Fig. 3 and 

H 

the description with reference thereto. 

The successive groups of pixels are applied to the filter [FIL] by means of 

f J 

||3 20 multiplexing devices [MA] shown in Fig. 2. There is a multiplexing device [MA] for each tap 



[T] of the filter [FIL]. Each multiplexing device [MA] receives the group of pixels produced 



nj 

^^ 

U as a result of the current read operation and the associated group of binary values. It fiirther 

receives the associated control word [CW]. The multiplexing device [MA] selects a pixel in 
order to apply this pixel to the tap [T] of the filter [FIL] to which the multiplexing device 

25 [MA] belongs. The multiplexing device [MA] selects the pixel indicated by the control word 
[CW] provided that this pixel is valid. This last-mentioned information is contained in the 
binary value associated with the pixel. If the pixel is not valid the multiplexing device selects 
a valid other pixel. If the group does not include any valid picture the multiplexing device 
[MA] selects a pixel in a random manner. In the last-mentioned case the resulting output 

30 pixel from the group of pixels will not be valid and, as a consequence, its value does not 
matter. 

The filter [FIL] multiplies the pixels applied to the taps [T] by the respective 
filter coefficients [C] associated with them. The multiplication of the pixel applied to the first 
tap [Tl] by the filter coefficient [CI] results in a first weighted pixel. The multiplication of 
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the pixel' applied to the second tap [T2] by the filter coefficient [C2] results in a second 
weighted pixel, etc. The four weighted pixels thus obtained are added in order to obtain an 
output pixel. 

Fig. 4 shows the first multiplexing device [MAI]. The other multiplexing 
5 devices [MA2, MA3, MA4] shown in Fig. 2 are identical. As described hereinbefore, the first 
multiplexing device [MAI] receives a group of four pixels [PX], a group of four associated 
binary values [BV] and the first control word [CWl] from the control circuit [CNTRL]. In 
response thereto, the first multiplexing device [MAI] selects a pixel in order to apply it to the 
first tap [Tl] of the filter [FIL] shown in Fig. 3. The pixels [PX] are numbered from one to 
10 four [PX1-PX4]. The binary values [BV] are also numbered from one to four [BV1-BV4]. 
The numbers indicate the respective memory banks [MB1-MB4] from which the pixels and 
their binary values are retrieved. 

The first multiplexing device [MAI] comprises a decoding circuit [DEC], a 
- first and a second OR circuit [ORl , 0R2], three logic circuits [LC], numbered firom one to 

€4 15 three [LC1-LC3] and three multiplexers [MUX], number firom one to three [MUX1-MUX3]. 



.'^ The first, the second and the third logic circuit [LC1-LC3] are associated with the first, the 

second and the third multiplexer [MUX1-MUX3], respectively. The three multiplexers 
[MUX] are of the type having two inputs and one output. A multiplexer selects an input in 
order to transfer the data on this input to another circuit. 

Q 

IS 20 The first multiplexing device [MAI] operates as follows. The decoding circuit 

'li [DEC] decodes the first control word [CWl] in order to obtain three basic control values 

13 [CV], numbered firom one to three [CV1-CV3]. The first, the second and the third basic 

control value [CV1-CV3] are associated with the first, the second and the third multiplexer 
[MUX1-MUX3], respectively. Each basic control value [CV] indicates the input to be 
25 selected by the relevant multiplexer [MUX]. 

Since each multiplexer [MUX] selects only one of two inputs each basic 
control value [CV] can be coded by means of a single bit. For example, if the basic control 
value [CV] is zero (0), this indicates that the relevant multiplexer [MUX] should select the 
left-hand input. Conversely, if the basic control value [CV] is one (1), it indicates that the 
30 multiplexer [MUX] should select the right-hand input. Let it be assumed that the control 

word [CW] indicates the second pixel [PX2]. In this case, the first basic control value [CVl] 
will be one (1) and the third basic control value [CV3] will be zero (0). Now the second basic 
control value [CV2] will not play any part and can consequently be zero (0) or one (1). 
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The logic circuits [LC] are arranged between the decoding circuit [DEC] and 
the multiplexers [MUX] in order to enable the basic control values [CV] to be changed. Each 
logic circuit [LC] receives two values in dependence on which the basic control value [CV] is 
changed or not. These two values are formed on the basis of the binary values [BV] 
5 associated with the relevant pixels [PX]. Each logic circuit [LC] thus supplies a final control 
value [CV] equal to the basic control value [CV] or opposed thereto, depending on the binary 
values [BV], The final control value [CV] determines the selection made by the multiplexer 
[MUX] to which it is applied. 

In more detail, the first logic circuit [LCI] changes or does not change the 
1 0 basic control value [CVi] depending on the first and the second binary value [BV 1 , BV2]. 
Let it be assumed that the first basic control value [CVI] is zero (0). The first basic control 
value [CVI] thus indicates that the first multiplexer [MUXl] should select the first pixel 
[PKl]. Let it fiirther be assumed that the first binary value [BVl] associated with the first 
pixel [PXl] is one (1). This means that this pixel is valid. In this case, the first logic circuit 
^0 15 [LCI] does not change the first basic control value [CVI]. The final first control value [CV'i] 

\ Is 

2 is consequently zero (0) and, as a result, the first multiplexer [MUXl] actually selects the 

first pixel [PXl]. Let it now be assumed that the first binary value [BVl] is zero (0) and that 
U the second binary value [BV2] is one (1). This means that the first pixel [PXl] is not vaUd, 

Jl,^ whereas the second pixel [PX2] is valid. In this case, the first logic circuit [LCI] alters the 

20 first basic control value [CVI]. The first final control value [CVT] is therefore one (1) and, 

|1J 

P consequently, the first multiplexer [MUXl] selects the second pixel [PX2] instead of the first 

pixel [PXl]. 

The first logic circuit [LCI] operates in a manner comparable to that in the 
case that the first basic control value [CVI] is one (1). In this case, it actually verifies if the 
25 second pixel [PX2] is valid. If the second pixel [PX2] is not valid, the first logic circuit [LCI] 
will change the first basic control value [CVI] so as to achieve that the first multiplexer 
[MUXl] selects the first pixel [PXl] provided that this is valid. 

The second logic circuit [LC2] operates in the same way as the first logic 
circuit [LCI] described hereinbefore. The second basic control value [CV2] takes the place of 
30 the first basic control value [CVI]. The third and the fourth binary value [BV3, BV4] take the 
place of the first and the second binary value [BVl, BV2], respectively. The second 
multiplexer [MUX2] takes the place of the first multiplexer [MUXl]. The third and the 
fourth pixel [PX3, PX4] take the place of the first and the second pixel [PXl, PX2], 
respectively. 
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The third logic circuit [LC3] receives two OR combinations of the binary 
values [BV]. The first and the second OR circuit [ORl, 0R2] supply a first OR combination 
and a second OR combination, respectively. The first OR combination is the result of an OR 
operation performed upon the first and the second binary values [BVl, BV2]. It indicates if 
5 the pixel selected by the first multiplexer [MUXl] is valid or not valid. The second OR 
combination is the result of an OR operation performed upon the third and the fourth binary 
value [BV3, BV4]. It indicates if the pixel selected by the second multiplexer [MUX2] is 
valid or not valid. 

The third logic circuit [LC3] operates in the same way as the first logic circuit 
10 [LCI] described hereinbefore. The third basic control value [CV3] takes the place of the first 
basic control value [CVl]. The first and the second OR combination take the place of the first 
and the second binary value [BVl, BV2], respectively. The third multiplexer [MUX3] takes 
the place of the first multiplexer [MUXl]. The pbcels selected by the first and the second 
2 multiplexers [MUXl, MUX2] take the place of the first and the second pixel [PXl, PX2]. 

^0 1 5 The MPEG4 video filtering arrangement described hereinbefore with reference 

Iq to Figs. 2-4 is an example of the implementation of the characteristic features illustrated in 

J W Fig. 1 . The input circuit [INP] shown in Fig. 1 takes the form of four memory banks [MBl- 

1=,^ MB4] and the control circuit [CNTRL] shown in Fig. 2. The basic control data [BCD] shown 

%^ in Fig. 1 take the form of four control word [CW1-CW4] shovm in Fig. 2. The additional 

20 control data [SCD] take the form of four binary values [BV1-BV4] shown in Fig. 4, the 
binary values being obtained from the memory banks [MB] shown in Fig. 2, The 



^ interconnection network [ICN] shown in Fig. 1 takes the form four multiplexing devices 

[MA1-MA4] shown in Fig. 2. The data processing circuit [PRC] shown in Fig. 1 takes the 
form of the filter [F] shovra in Fig. 2. 
25 ' The above description with reference to various Figures illustrates rather than 

limits the invention. It is evident that there are numerous alternatives within the scope of tiie 
appended Claims. In conclusion, some remarks are made in this respect. 

There are numerous methods of forming successive groups of data. The 
MPEG4 video filtering arrangement shown in Fig. 2 forms groups of four data items. Other 
30 implementations of the invention may form, for example, groups of two, three, five or six 
data items, etc. The number of items in a group is not relevant. 

There are numerous methods of processing a group of data. The MPEG4 video 
filtering arrangement shovm in Fig. 2 forms a weighted combination of a group of data. Other 
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iitiplemehtations of the invention may perform other types of processing, for example a 
discrete cosine transform. 

There are numerous methods of rearranging a group of data. The MPEG4 
video filtering arrangement shown in Fig. 2 comprises four multiplexing devices [MAI- 
5 MA4], each including three multiplexers [MUX1-MUX3] of the type having two inputs and 
one output, as shown in Fig. 4. Other implementations of the invention may include 
multiplexers of other types. It is possible, for example, to replace the four multiplexing 
devices [MA1-MA4] shown in Fig. 2 with a single multiplexer of the type having sixteen 
inputs and four outputs and an appropriate logic circuit. It is likewise possible to replace the 
1 0 three multiplexers of the type having two inputs and one output, as shown in Fig. 4, v^th a 
single multiplexer of the type having four inputs and one output. In this respect, it is to be 
noted that the multiplexing device shovm in Fig. 4 comprises, in fact, two multiplexing 
layers: a first layer including the first and the second multiplexer [MUXl, MUX2] and a 
second layer including the third multiplexer [MUX3]. Replacing the three multiplexers of the 
15 type having two inputs and one output, as shovm in Fig. 4, v^th a single multiplexer of the 
type having four inputs and one output means, in fact, that a multiplexing device is formed 
Hi having a single layer instead of two layers. Let it now be assumed that the groups of data 

comprise 8 data items instead of 4 data items as shown in Fig. 4. In this case, it is possible, 
for example to realize a multiplexing device having a single layer by means of a multiplexer 
20 of the type having eight inputs and one output, or having two layers by means of multiplexers 

■2 of the type having four inputs and one output, or having three layers by means of 

fit?? 

Q multiplexers of the type having two inputs and one output. 

There are numerous ways of implementing functions by means of items of 
hardware or software or a combination of the two. In this respect, it is to be noted that the 
25 Figures are highly diagrammatic, each Figure representing merely a single embodiment of 
the invention. Thus, although a Figure shows different functions as separate blocks, this does 
not exclude the possibility that a single item of hardware or software performs a plurality of 
functions. This by no means excludes the possibility that a function may be carried out by a 
set of hardware or software items. 
30 For example, the MPEG4 video filtering arrangement shovm in Fig. 2 

comprises different blocks which, in combination, form groups of data and processes these. 
In principle, it is possible to realize these blocks by means of a suitably programmed 
computer circuit. A set of instructions contained in a program memory can cause the 
computer circuit to carry out the different operations described hereinbefore with reference to 
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Figs. 2-4*. The set of instructions can be loaded into the program memory by reading a data 
carrier, for example a disc which carries the set of instructions. Reading may be effected via a 
communication network such as, for example, the internet. In this case, a service provider 
will make the set of instructions available to those interested. 

Any reference signs given in parentheses in a claim shall not be construed as 
limiting said claim. The use of the verb "to comprise" does not exclude the presence of any 
other elements or steps other than those defined in a claim. The use of the indefinite article 
"a" or "an" preceding an element or step does not exclude the presence of a plurality of these 
elements or steps. 



